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We show some incompleteness results a la Chaitin using the busy beaver functions. Then, with 
the help of ordinal logics, we show how to obtain a theory in which the values of the busy beaver 
functions can be provably established and use this to reveal a structure on the provabihty of the values 
of these functions. 



1 Introduction 

When considering a class of Turing machines that halt when started from a blank tape, busy beavers for 
that class, as coined by Tibor Rado, are those Turing machines which eventually halt after the maximum 
number of steps (or after producing the maximum number of non-blank symbols). Finding for a class of 
Turing machines the busy beaver champion (for any of the two competitions) is of course uncomputable 
|[T9l . Nevertheless, efforts have been made to try to find the champions starting with the smallest classes 
of Turing machines. Finding all the different kinds of behavior of Turing machines in a class is quite 
exhilarating an endeavor. Rona J. Kopp [9] and Allen H. Brady |3| have thoroughly studied the four states 
and two symbols class and Heiner Marxen and others |[T5l [T6l have tried for more than two decades to 
experimentally find the busy beaver champion for the five states and two symbols class. Heiner Marxen 
found a candidate but no one has been able to prove that no other machine does better. This is most 
certainly because the behaviors involved are too complicated. This state of affairs is an encouragement 
to the study of what we have called low-level reverse computability: What does it take to be able to 
comprehend the behavior of a certain class of Turing machines? What is needed to be able to prove these 
behaviors? These questions raise the links between the study of busy beavers and incompleteness. 

To start off, there is a need to see the strong Unks between computabiUty and incompleteness. For 
instance, one can obtain a first form of the first incompleteness theorem by considering propositions of 
the form n where X is a non-recursive but recursively enumerable set, e.g., the diagonal halting set 
J(f . Even if the language of the considered theory does not contain G, there is a simple algorithm that 
generates given n the proposition "« X". Given a sound (every provable statement is true) recursively 
enumerable theory T , there is a number ?io such that no ^ X but T does not prove it. The proof is direct: 
Suppose that there is no such «o> then we would have that T proves "« X" if and only n ^X, and X 
would be recursive (generate the theorems of T and at the same time enumerate X; if « G X then n will 
eventually show up in the enumeration; otherwise, "« ^ X" will eventually show up in the theorems of T 
and be true by the soundness assumption). We thus have a true sentence, "?io ^ X", which is not provable 
in T. 
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Incompleteness is also famously linked to computability via Chaitin's incompleteness theorem. 
Chaitin's result, showing that there are unprovable statements on Kolmogorov-Chaitin complexitjQ, is a 
form of Godel's first incompleteness theorem. Actually, Kolmogorov showed in the sixties that the set 
of random (or incompressible) numbers, i.e., {x : K{x) ^ x}, is recursively enumerable but not recursive, 
and, by the above argument, this is already a version of Godel's first incompleteness theorem. Moreover, 
Kolmogorov's proof can be seen as an application of BeiTy's paradox ("the least integer not nameable 
in fewer than seventy characters" has just now been named in sixty-three characters). Following Boolos 
|[T1, it is thus no wonder that we can get proofs using this Kolmogorov complexity function (or other 
similar computability-related functions) of both incompleteness theorems (see ifTOl ). 

One of the reasons of the existence of the quest for better understanding the incompleteness phe- 
nomenon lies in the peculiarity of Godel's unprovable statements. They are not natural mathematical 
statements: no mathematician has ever stumbled on them (or should we say over them ?). And thus, it 
seems to many that normal mathematical practice is not concerned with the incompleteness phenomenon. 
More and more results show however the contrary. In particular, Harvey Friedman's 11*' statements, that 
are unprovable in Zermelo-Fraenkel (ZF) set theory and need the 1 -consistency of strong set-theoretical 
unprovable statements (going way beyond ZF) to be proved, are examples of such results. 

Nevertheless, incompleteness theorems only provide unprovable statements like the consistency of 
a theory, that ai^e of an unclear- nature. What combinatorial properties does the consistency statement 
bring to a theory? Having a link between consistency (or soundness) and computability, in particular 
Kolmogorov complexity, would make possible an understanding of what properties consistency adds to 
a theory. Adding consistency as an axiom would then yield new combinatorial properties because of the 
existing links between combinatorics and Kolmogorov complexity. For a detailed exposition of the links 
between Godel incompleteness and Kolmogorov complexity, see lITOll . 

In the first part of this article, we start by giving an incompleteness theorem a la Chaitin using the 
busy beaver functions and then make precise the kind of incompleteness theorems one can obtain with 
them. In the second part, we use ordinal logics to construct a theory in which the values of the busy 
beaver functions can be provably established and use this to find a structure on the provability of the 
values of these functions. 

Notational conventions 

On top of the usual logical connectives (A, V and -■), we will respectively denote the logical connectives 
of implication and equivalence by o and =. 

When we have a recursively enumerable axiomatic theory T , Consy designates the arithmetical sen- 
tence that there is no proof of = 1. When the axioms of T are defined by a formula 0, Cons(^) will 

'Loosely speaking, the Kolmogorov-Chaitin complexity of a natural number n, denoted by K{n), is the smallest size of a 
program which generates n. 

Another useful variant of Kolmogorov-Chaitin complexity can be defined as follows. To each enumeration {(p/jigN of 
computable partial functions, we associate a variant of K: K^(x\y) = smallest e such that <Pe{y) = x, and K(p(x) = K(p(x\0). 
Chaitin's version of Godel incompleteness is the following theorem. 

Theorem 1.1 (Chaitin's incompleteness). Let T be an arithmetical-able consistent theory. There is a constant cj such that for 
all X, "K{x) > Cj- " is unprovable in T. 

For more on Kolmogorov-Chaitin complexity, the reader is referred to Il4l . For a formal definition of arithmetical-ability, 
see QOl. 
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designate Consj- using that formalization. The provability predicate is designated by Provr. 

The partial recursive functions computed by Turing machines, following a fixed convention, are 
denoted by {<j!>,}ieN (agreeing with the Turing machines' coding: (pi is the partial function computed 
by Tj). The sets denote the recursively enumerable sets, i.e., the domains of partial recursive 

functions. 

Concerning computability, the reader is referred to |[T7l[T8ll2ni20ll23ll25]| . 

2 Incompleteness and busy-beaverhood 

In the sixties, Tibor Rado, a professor at the Ohio State University, thought of a simple non-computable 
function other than the standard halting problem for Turing machines. Given a fixed finite number of 
symbols and states, select those Turing machines which eventually halt when run with a blank tape. 
Among these programs, find the maximum number of non-blank symbols left on the tape when they halt. 
Alternatively, find the maximum number of time steps before halting. These functions are well-defined 
but uncomputable. Tibor Rado called them the busy beaver functions. For more on the busy beaver 
problem, read |[l9l[IIl[l3l|2lli[2l3|6lia[l6l[l5l[ll. 

Alternative functions can be defined that are close in nature to these busy beaver functions. Let a^^'^^^ 
be the function which to / gives the maximum number of steps for which a Turing machine with code ^ / 
will keep running before halting, starting with a blank tape. For a Turing machine M, tM denotes the time 
complexity function of M: ?m(-^) = ^ if M{x) halts after s steps. Following the busy beaver functions' 
definitions, we define a™'"*^ to be the function which to / gives the maximum number which a Turing 
machine with code ^ / will output, following a fixed convention, after halting starting with an input ^ /. 
These functions are in a sense inverses of the K(f, function (see footnote [U. 

Other functions can be defined following classical Kolmogorov complexity, e.g., the function which 
to n gives the biggest number with Kolmogorov complexity lower than n. 

We call these functions the a functions. For each variant, we can define a function focusing on 
maximizing the number of steps, e.g., a^^teps^ ^j. j-j^g output values, e.g., a™'"*^. The value of either of 
these functions on a certain x is computable from x and the value of the other function on input ;c + c for 
a certain constant c (see |[22ll ). 

A result similar to Chaitin's incompleteness result concerning Kolmogorov complexity can be ob- 
tained concerning the a function^: 

Theorem 2.1 (Chaitin-lrke incompleteness theorem for a functions). Let o be one of the a functions. 
Let T be an arithmetical-ablJ^ consistent theory. There is a constant such that 

rhCons7-^V5^Prov7-(^a(n^) <5^). (1) 

Proof. Consider a Hi formula 0^ in the language of T such that (pcs{x,s) expresses that a{x) < s. 

Working in T, for a given x, take the smallest s such that Provj- Ci^cj {x, s) ~') holds. T being consistent 
and <j)ff Hi, (j)(y{x,s) also holds. 

a function is any of thie busy beaver functions defined above. 
"'For a formal definition of arithmetical-ability, see 1101 . 
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PmwY{'~^a{x,s)^) is aZi formula and thus can be seen as 3yY{x,s,y) or equivalently 3{s,y)Y{x,^,y) 
where y is Aq. 

Thus there is a Turing machine computing xj/. Consider its code i^, (or its number of states or 
transitions, depending on the choice of a). For large enough x, i.e., x > /|^ + c, knowing that (l)(j{x,s) 
holds (using the computation through shifting, i.e., the constant c, between both types of a functions), 
we know that g{x) < s and thus there is an s' = (^1,^2) < s such that ,^2) holds. But for each 

s' = {s\ , s'2) smaller than s, the statement -^^f{x, s\ ,82)1^ true by the minimality of s, and provable (being 
Aq). Thus we have -iConsj. □ 

We say that a statement is a revelation for T if is unprovable in T and its consistency relative to 
T (if T is consistent, so is T + 0) is provable from itself in T: 

T h ^ oCons7(^) 

We have the following result showing how being able to prove an upper bound for a a function can 
be a revelation. 

Theorem 2.2 (Serendipitous incompleteness theorem for a functions). Let a be one of the a functions. 
IfT is consistent, then there exists a natural number Xj such that for all x, o{tj) < x is a revelation 
for T. 

Proof. Consider the ITi statement Vx y{^)x equivalent to Consr+0. 

i/A € Aq and thus there is a machine M^, with code i^, such that M^, decides {x : y{x)x}- on input 
X eventually enters an acceptance state if y{^)x, or a rejection state otherwise. 

Consider another Turing machine Mj^ which runs successively on each natural number starting 
from and stops and writes the counter example of xf/ if the simulation of My, enters a rejection state. 

Let i'^ be the code of Turing machine M'^. cj(/'y,) makes the verification of Vx y{x)x a Aq property. 

By using Kleene's recursion theorem on this previous construction, we find such that knowing (or 
bounding) the value of (7(r^) makes the verification of Cons7^fj(jnj^^. a Aq property. Knowing that T is 
consistent and assuming cj(r^) ^x,T thus proves Consr(a(r^) ^ x). 

By Godel's second incompleteness theorem, CT(r^) ^ x is an unprovable statement in T. □ 

This can be done for other uncomputable functions, like Kolmogorov complexity functions (using 
the Turing-completeness of their graphs). Truth-table completeness is a plus to be able to have a finite 
revelation (finite number of constants cfj giving the revelation /\K{x) > cf-p)- 

The same idea can be used to find a constant j-zt^ such that if T and T' are consistent, then for all x, 
T h (7(7-' r^) <x<> l-Consy/. This can be done for other soundness properties than 1 -consistency. 

By combining the proofs of the two previous theorems 12.11 and I2I21 we obtain : 

Corollary 2.3 (Busy beaver pairs). Let a be one of the a functions. IfT is consistent, then there exist 
Sq'^ and s^'^ such that for all x. 



T h a(so'^) <xoV5^Provr(^a(5f''~) < s''). 
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3 Having enough power to comprehend busy beavers 

We start by recalling the basic notions encompassing ordinal logics. We first need the notion of ordinal 
notation. 

Let (O C N, -<o, I • I) be defined inductively, simultaneously on -<o and | • | : O ^ Ord, as follows: 
G O and |0| = 0; 

If a G O, then g{a) = {a,0) G O, a -<o g{a), and \g{a)\ = \a\ + 1; 

If (pe is a total function which is increasing according to -<o (for all n, (Pe{n) + l))^ then 

■&{e) = (e, 1) G O, T}{e) >-o (Pe{n) for all n, and = lim„££a We{n)\. 

Elements of O are called notations. g{a) denotes the successor of a, ■&{e) the limit of e. O is called 
the general ordinal representation system because every ordinal representation system is isomorphic 
to Oa = {b -<o a} for a particular a. Because of the definition of 'd{e), assuming (pe to be total and 
increasing, -<o is uncomputable, even not recursively enumerable. 

Starting from a theory T, we can now define progressions of theories indexed by notations. 

To = T 

r5(„) = r+Cons(r) 

The idea is to have a sequence of theories indexed by ordinals showing how many times we assume 
the consistency of the previous theories, the predecessor theory if the ordinal is a successor and all 
previous theories if a limit ordinal. The difficulty lies in always having recursively enumerable axiomatic 
theories, /.e, having a sequence of formulae (^a defining the axioms of Ta and definable from previous (/)'s. 
Turing |[24l and later Feferman Q came up with this idea of recursive progressions of theories. Kleene's 
second recursion theorem shows the existence of such recursive progressions. Notice that assuming the 
soundness of the base theory T, if we add its consistency to the axioms of T, then we know that this 
enhanced theory is also sound. Hence, soundness is inherited by consistency extensions. 

Now, the problem is that Ta is not consistent for all a even when assuming the soundness of T: by 
Kleene's recursion theorem, there is e such that <Pe(0) = and for such e, T^(_e) proves all that 

Tg{^{e)) proves, in particular ConSf^^^^; thus r^(g) is inconsistent. 

To ensure that r„ is a consistency extension of T, one has to make sure that a belongs to O. One 
way of doing that is working only with a's from a branch of O, that is a linearly ordered subset of O 
closed under ^o- A better way is considering only notations, elements of D, such that if a G D and an 
arithmetically definable variant of "b G O" is provable in then b G D. 

In theorem [XT] we use arguments along the lines of Turing's |[24l as they were described by Feferman 
HTllll. 

Theorem 3.1 (Point-wise provability of a values). Let a be one of the a functions. For any consistency 
progression, for all a and for all x^'H, there exists ax^O with a -<o ax such that \ax \ = \a\ + (0 + l 
and Ta^ proves all true statements of the form "o{x) < ■ ■ ■". 

Proof. Consider a Hi formula <p(y{x,s) = V? \i/(j{t,x,s) in the language of T such that ^(j(x,s) expresses 
a{x) < s and Ya is Aq. 
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Let Gx be the true value of o{x) + I. By Kleene's recursion theorem, let be such that provably in 
PA, for every n, 

( \ — j '^(^'''i is true for every / < n, 

9eA^> - I g{T}{ex)) otherwise. 

Since V? Y{t,x,s) is true, T^{ex) S O and = \a\ + ft). Let ax = g{T}{ex)). If -iVf Y{t,x,s), then 

'^<PeA") ^'^^ sufficiently large n and so T^(^e,) ^Iso proves the consistency of T^[e,)- Thus by Godel's 
second incompleteness theorem, T^[e,) is inconsistent. Hence, since we can prove in Ta^ the consistency 
of V? jCji) is also provable in Ta^. □ 

For any class of machines, it is thus possible with a combination of theories from a progression of 
theories to comprehend the busy beaver functions on that class. 

By an extensive use of Kleene's recursion theorem and by varying the theory in the use of corollary 
12.31 we get the following corollary. 

Corollary 3.2 (Busy beaver relationships). Let a be one of the o functions. IfT is consistent, then for 
all n > I, there exist {s^'^};<„ such that for all s, a(sQ'^) < s is not provable in T, and for all x and 
i < {n-l), 

r H a(s^'^) <;coV5^Prov7-(^a(5,'^[) < 5^). 
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